Information processing apparatus and control method

ABSTRACT

In a case where an inspection level to be used in determining quality of an image of an inspected surface of a printed sheet is set based on a comparison between a captured image resulting from imaging the inspected surface and a reference image, a plurality of inspection regions varying in inspection level is set for the reference image. In a case where an overlap region is present in the plurality of inspection regions, an inspection level of the overlap region is identified based on a predetermined priority. Further, the identified inspection level of the overlap region is displayed.

BACKGROUND Technical Field

The present disclosure relates to a technique of inspecting the qualityof a printed sheet in a printing apparatus.

Description of the Related Art

Some known inspection apparatuses read a sheet printed by a printingapparatus and inspects the quality of the printed sheet. The inspectionapparatus is capable of detecting image defects, such as dirt and printomission, errors in text, bar code quality, and the like.

Required quality varies depending on a business type and a printed sheetof a user, and thus it is important to perform an inspection desirableand sufficient for an inspection requirement. If an inspection criterionis too loose, printed sheets having defects can be shipped. However, ifan inspection criterion is too strict, a printed sheet that is to betreated as a non-defective may be determined to be a defective, so thatthe number of discarded sheets can increase, or an additional burden ofvisually checking whether defective sheets have defects can be placed ona user.

To address such an issue, Japanese Patent Application Laid-Open No.2005-217931 discusses a technique of applying different inspectioncriteria to a fixed region and a variable region in variable dataprinting is discussed.

In Japanese Patent Application Laid-Open No. 2005-217931, however, acase where regions to which different inspection criteria are appliedoverlap within an image is not discussed. For this reason, in a casewhere regions to which inspection criteria are applied overlap within animage, a user cannot check whether an inspection is performed using adesired inspection criterion. Hence there is such an issue that it isdifficult to check whether an inspection is performed by applying aninspection criterion desired by a user to a user-desired region ofuser-desired print data.

SUMMARY

The present disclosure is directed to presentation for enabling a userto easily recognize which inspection criterion is to be applied to apixel in a case where there is an overlap between inspection regions towhich different inspection criteria are applied.

According to an aspect of the embodiments, an information processingapparatus sets an inspection level to be used in determining quality ofan image of an inspected surface of a printed sheet, based on acomparison between a captured image resulting from imaging the inspectedsurface and a reference image. The information processing apparatusincludes a setting unit, an identification unit, and a display controlunit. The setting unit is configured to set a plurality of inspectionregions varying in inspection level, for the reference image. Theidentification unit is configured to identify, in a case where anoverlap region is present in the plurality of inspection regions, theinspection level of the overlap region based on a predeterminedpriority. The display control unit is configured to display theidentified inspection level of the overlap region.

Further features of the disclosure will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram illustrating a configuration including aninformation processing apparatus, an inspection apparatus, and aprinting apparatus.

FIG. 2 is a block diagram illustrating a configuration of each of theinformation processing apparatus, the inspection apparatus, and theprinting apparatus.

FIG. 3 is a block diagram illustrating an internal configuration of eachof an inspection unit, the printing apparatus, and a large capacitystacker.

FIG. 4 is a flowchart illustrating basic operation of the inspectionapparatus.

FIG. 5 is a flowchart illustrating basic operation of the inspectionunit in executing inspection.

FIGS. 6A, 6B, and 6C each illustrate an inspection setting screen.

FIG. 7, which is comprised of FIGS. 7A and 7B, is a flowchartillustrating inspection region setting operation of the inspectionapparatus.

FIG. 8 is a flowchart illustrating inspection operation of theinspection apparatus.

DESCRIPTION OF THE EMBODIMENTS

Exemplary embodiments of the present disclosure will be described belowwith reference to the accompanying drawings. The present disclosure isapplicable to an inspection apparatus irrespective of whether theinspection apparatus is a single apparatus or a plurality of apparatusesif a function according to the present disclosure is implemented, unlessotherwise specified. The inspection apparatus may be connected to otherapparatuses via networks such as a local area network (LAN) and a widearea network (WAN) to perform processing if a function according to thepresent disclosure is implemented, unless otherwise specified. In otherwords, a system configuration in which various terminals to be describedin the following exemplary embodiments are connected is merely anexample, and there are various configuration examples depending on theintended use and purpose.

FIG. 1 is a schematic diagram illustrating an inspection system in anexemplary embodiment, and illustrates a configuration including aninformation processing apparatus, an inspection apparatus, and aprinting apparatus. In the printing apparatus of the present exemplaryembodiment, a description will be provided of a printing apparatusemploying an electrophotographic method, but the printing apparatusaccording to the present exemplary embodiment may be a printingapparatus employing any of other types of image forming method, such asan inkjet method and an offset method.

A printing apparatus 0101 is connected to an information processingapparatus 0109 via a cable 0112. The information processing apparatus0109 is connected to a client computer 0110 and an inspection apparatus0108 via a network 0113.

The printing apparatus 0101 includes a user interface (UI) panel 0102, asheet feeding deck 0103, and a sheet feeding deck 0104. Further, anoptional deck 0105 that is a three-tier sheet feeding deck is connectedto the printing apparatus 0101. The printing apparatus 0101 is, forexample, an electrophotographic printing apparatus. The UI panel 0102is, for example, a user interface including a capacitive touch panel.

The printing apparatus 0101 further includes an inspection unit 0106 anda large capacity stacker 0107. The inspection unit 0106 is connected tothe inspection apparatus 0108 via a cable 0114. The large capacitystacker 0107 includes a main tray and a top tray, and the main tray canbe loaded with several thousand sheets at a time.

The client computer 0110 generates a print job, the generated print jobis transmitted to the information processing apparatus 0109 via thenetwork 0113, and the information processing apparatus 0109 manages thereceived print job. The print job is transmitted from the informationprocessing apparatus 0109 to the printing apparatus 0101 via the cable0112, and the printing apparatus 0101 performs a process of printing ona sheet based on the received print job. The print job may be generatedand managed by the information processing apparatus 0109, and may betransmitted from the information processing apparatus 0109 to theprinting apparatus 0101 via the cable 0112 to be printed by the printingapparatus 0101.

The client computer 0110, the information processing apparatus 0109, andthe inspection apparatus 0108 may be connected to the cable 0112 tocommunicate with the printing apparatus 0101. In other words, theconnection configuration of the printing apparatus 0101, the informationprocessing apparatus 0109, and the client computer 0110 in the presentexemplary embodiment is merely an example, and any of various connectionconfigurations different from that in the present exemplary embodimentmay be employed.

FIG. 2 is a block diagram illustrating a control configuration of eachof the printing apparatus 0101, the inspection apparatus 0108, the largecapacity stacker 0107, the information processing apparatus 0109, andthe client computer 0110 of the present exemplary embodiment.

A central processing unit (CPU) 0201 is in charge of control andcomputations in each component in the printing apparatus 0101 via asystem bus 0212. The CPU 0201 is in charge of execution of a programstored in a storage unit 0205 and loaded into a random access memory(RAM) 0202. The RAM 0202 is a type of commonly used volatile storagethat enables direct access from the CPU 0201, and the RAM 0202 is usedas a work area or other temporary data storage area for the CPU 0201.The storage unit 0205 functions as a temporary storage area and a workmemory when the printing apparatus 0101 operates.

An engine interface (I/F) 0209 is in charge of control of andcommunication with a printer engine 0210. A sheet feeding deck I/F 0204is in charge of control of and communication with a sheet feeding deck0211. The sheet feeding deck 0211 is a hardware configuration thatrepresents the sheet feeding decks 0103 and 0104 as well as the optionaldeck 0105 collectively. A UI panel 0203 is a hardware configuration ofthe UI panel 0102, and is a user interface for performing all types ofoperations on the printing apparatus 0101. In the present exemplaryembodiment, the UI panel 0203 includes a capacitive touch panel.

A network interface (hereinafter, NW I/F) 0207 is connected to a NW I/F0238 of the information processing apparatus 0109 via a cable 0213, andis in charge of communication between the information processingapparatus 0109 and the printing apparatus 0101. In this example, theinterface connected to the system bus 0212 and the interface connectedto a system bus 0239 are directly connected, but the informationprocessing apparatus 0109 and the printing apparatus 0101 may beconnected by, for example, a network, i.e., the connection form thereofis not limited. A video I/F 0206 is connected to a video I/F 0233 via avideo cable 0241, and is in charge of image-data communication betweenthe information processing apparatus 0109 and the printing apparatus0101.

The connection interface with the printing apparatus 0101 in theinformation processing apparatus 0109 may be in a form in which thefunction of the NW I/F 0238 and the function of the video I/F 0233 areintegrated. The connection interface with the information processingapparatus 0109 in the printing apparatus 0101 may be in a form in whichthe function of the NW I/F 0207 and the function of the video I/F 0206are integrated.

An accessory I/F 0208 is connected to an accessory I/F 0214 and anaccessory I/F 0220 via a cable 0225. In other words, the printingapparatus 0101 communicates with the inspection unit 0106 and the largecapacity stacker 0107 via the accessory I/Fs 0208, 0214, and 0220.

A CPU 0216 is in charge of control and computations in each component inthe inspection unit 0106 via a system bus 0219. The CPU 0216 is also incharge of execution of a program stored in a storage unit 0247 andloaded into a RAM 0217. The RAM 0217 is a type of commonly used volatilestorage that enables direct access from the CPU 0216, and the RAM 0217is used as a work area or other temporary data storage area for the CPU0216. The storage unit 0247 functions as a temporary storage area and awork memory when the inspection unit 0106 operates. An inspectionapparatus I/F 0215 is connected to an inspection unit I/F 0231 via acable. In other words, the inspection unit 0106 communicates with theinspection apparatus 0108 via the inspection apparatus I/F 0215 and theinspection unit I/F 0231.

An imaging unit 0218 has an imaging function provided with, for example,a contact image sensor (hereinafter, CIS), and the imaging unit 0218captures an image of a sheet passing through the inspection unit 0106and transmits the captured image to the inspection apparatus 0108 viathe inspection apparatus I/F 0215. The CIS for the imaging unit 0218 isan example of a sensor, and may be other types of sensor, such as acharge coupled device (CCD) image sensor, and the imaging method thereofis not limited.

A CPU 0221 is in charge of control and computations in each component inthe large capacity stacker 0107, and execution of a program stored in astorage unit 0248 and loaded into a RAM 0222, via a system bus 0224. TheRAM 0222 is a type of commonly used volatile storage that enables directaccess from the CPU 0221, and the RAM 0222 is used as a work area orother temporary data storage areas for the CPU 0221. The storage unit0248 functions as a temporary storage area and a work memory when thelarge capacity stacker 0107 operates. A sheet discharge unit 0223 is incharge of operation of discharging sheets to the main tray and the toptray, as well as monitoring of the stacking status and control of eachof the main tray and the top tray.

A CPU 0226 is in charge of control and computations in each component inthe inspection apparatus 0108, and execution of a program stored in astorage unit 0228 and loaded into a RAM 0227, via a system bus 0230. TheRAM 0227 is a type of commonly used volatile storage that enables directaccess from the CPU 0226, and the RAM 0227 is used as a work area orother temporary data storage area for the CPU 0226.

The storage unit 0228 functions as a temporary storage area and a workmemory when the inspection apparatus 0108 operates. A page descriptionlanguage (PDL) analysis unit 0229 reads PDL data such as PortableDocument Format (PDF) data, PostScript data, and Printer CommandLanguage (PCL) data received from the client computer 0110 and theinformation processing apparatus 0109, and executes interpretationprocessing on the read-in PDL data. A display unit 0245 is, for example,a liquid crystal display connected to the inspection apparatus 0108, andreceives an input into the inspection apparatus 0108 from a user, andcontrols display such as displaying a status of the inspection apparatus0108.

A CPU 0234 is in charge of control and computations in each component inthe information processing apparatus 0109, and execution of a programstored in a storage unit 0236 and loaded into a RAM 0235, via the systembus 0239. The RAM 0235 is a type of commonly used volatile storage thatenables direct access from the CPU 0234, and the RAM 0235 is used as awork area or other temporary data storage areas for the CPU 0234.

The storage unit 0236 functions as a temporary storage area and a workmemory when the information processing apparatus 0109 operates. A NW I/F0237 is connected to a NW I/F 0232 and a NW I/F 0240 via a network. Theinformation processing apparatus 0109 communicates with the inspectionapparatus 0108 via the NW I/F 0237 and the NW I/F 0232. The informationprocessing apparatus 0109 communicates with the client computer 0110 viathe NW I/F 0237 and the NW I/F 0240.

A CPU 0243 is in charge of control and computations in each component inthe client computer 0110, and execution of a program stored in a storageunit 0244 and loaded into a RAM 0242, via a system bus 0246. The RAM0242 is a type of commonly used volatile storage that enables directaccess from the CPU 0243, and the RAM 0242 is used as a work area orother temporary data storage areas for the CPU 0243. The storage unit0244 functions as a temporary storage area and a work memory when theclient computer 0110 operates.

FIG. 3 is a diagram illustrating an internal configuration of each ofthe printing apparatus 0101, the inspection unit 0106, and the largecapacity stacker 0107.

The printing apparatus 0101 receives an input from the user via the UIpanel 0102, and displays a printing or apparatus status. The sheetfeeding decks 0103 and 0104 can contain various sheets. In each of thesheet feeding decks 0103 and 0104, only one sheet that is the uppermostsheet among the contained sheets can be separated and the separatedsheet can be conveyed to a sheet conveyance path 0305. Developmentstations 0301 to 0304 form respective toner images using Yellow,Magenta, Cyan, and Black (Y, M, C, and K) color toners, respectively, toform a color image. The toner images formed here are primarilytransferred to an intermediate transfer belt 0306.

The intermediate transfer belt 0306 circulates clockwise in FIG. 3, andthe toner images are transferred to the sheet conveyed from the sheetconveyance path 0305 at a secondary transfer position 0307. A fixingunit 0308 includes a pressure roller and a heating roller. The sheetpasses between these rollers, so that the fixing unit 0308 fixes thetoner images to the sheet by fusing and crimping the toners. The sheetthat has passed the fixing unit 0308 is conveyed to a sheet conveyancepath 0312 via a sheet conveyance path 0309. In a case where furtherfusing and crimping is desirable for fixing depending on the type ofsheet, the sheet that has passed through the fixing unit 0308 isconveyed to a second fixing unit 0310 through an upper sheet conveyancepath, and is additionally fused and crimped. The sheet is then conveyedto the sheet conveyance path 0312 via a sheet conveyance path 0311. In acase where an image forming mode is a two-sided mode, the sheet isconveyed to a sheet reversing path 0313 and reversed on the sheetreversing path 0313, the reversed sheet is conveyed to a two-sidedconveyance path 0314, and the toner images are transferred to the secondside of the sheet at the secondary transfer position 0307.

The inspection unit 0106 contains a CIS 0315 and a CIS 0316 facing eachother. The CIS 0315 is a sensor for reading the top surface of the sheetand the CIS 0316 is a sensor for reading the undersurface of the sheet.The inspection unit 0106 scans (captures an image of) the sheet by usingthe CIS 0315 and the CIS 0316 at the timing when the sheet conveyed to asheet conveyance path 0317 arrives at a predetermined position. Thescanned (captured) image is transmitted to the inspection apparatus 0108via the inspection apparatus I/F 0215 and the inspection unit I/F 0231.The CPU 0226 determines whether the received image has a defect andnotifies the inspection unit 0106 of a determination result via theinspection unit I/F 0231 and the inspection apparatus I/F 0215. The CPU0216 notifies the large capacity stacker 0107 of the receiveddetermination result via the accessory I/Fs 0214 and 0220.

The large capacity stacker 0107 is a stacker that can be loaded with alarge amount of sheets. The large capacity stacker 0107 includes a maintray 0324 as a tray to be loaded with sheets. The sheet that has passedthrough the inspection unit 0106 enters the large capacity stacker 0107via a sheet conveyance path 0319. The sheet is placed in the main tray0324 from the sheet conveyance path 0319 via a sheet conveyance path0322. The large capacity stacker 0107 further includes a top tray 0320as a sheet discharge tray.

The CPU 0221 discharges a sheet having a defect detected by theinspection apparatus 0108 to the top tray 0320. In a case where thesheet is to be output to the top tray 0320, the sheet is conveyed fromthe sheet conveyance path 0319 to the top tray 0320 via a sheetconveyance path 0321. A reversing portion 0323 is provided to reverse asheet. The reversing portion 0323 is used for reversing sheets. Thereversing portion 0323 is used in a case where the sheet is to be placedin the main tray 0324. In a case where the sheet is to be placed in themain tray 0324, the sheet is reversed at the reversing portion 0323 onceso that the orientation of the sheet when entering and the orientationof the sheet when placed become the same. In a case where the sheet isconveyed to the top tray 0320, the sheet is directly discharged withoutbeing flipped when the sheet is placed, and thus the reversing operationat the reversing portion 0323 is not performed.

FIG. 4 is an operation flowchart illustrating basic operation of theinspection apparatus 0108 in performing inspection.

In step S0401, the CPU 0226 receives an image reading start instructionfrom the user via the display unit 0245. The operation subsequentlyproceeds to step S0402, and further to step S0403 in a case where thereis a sheet to be an inspection target.

In step S0403, the inspection unit I/F 0231 receives an image scanned byeach of the CIS 0315 and the CIS 0316 from the inspection apparatus I/F0215. Next, in step S0404, the CPU 0226 compares a reference imagestored in the RAM 0227, with the scanned image of the inspection targetreceived in step S0403. This comparison processing is performed for theimage on one side (the captured image on an inspected surface) in thecase of one-sided inspection, and performed for the image on each ofboth sides in the case of two-sided inspection. As to the referenceimage, a sheet printed by the printing apparatus 0101 is scanned usingeach of the CIS 0315 and the CIS 0316, and the resultant images aretransmitted from the inspection apparatus I/F 0215 to the inspectionunit I/F 0231, and the transmitted images are saved in the RAM 0227 asthe reference images, before the start of this flow.

In this comparison operation, at first, the CPU 0226 aligns the imageposition of the scanned image of the inspection target and the imageposition of the reference image by using a feature point of the scannedimage as an alignment reference point. Next, the CPU 0226 detectswhether there is a misalignment of the image with respect to the sheetby analyzing the four corners of the sheet and the alignment referencepoint of the scanned image, in the scanned image of the inspectiontarget. The CPU 0226 then compares the density value of the scannedimage of the inspection target and the density value of the referenceimage pixel by pixel. If no defect is detected as a result of thiscomparison, the inspection result is determined to be acceptable. In thecase of the two-sided inspection, the inspection result is determined tobe acceptable if no defect is detected for the image on each of bothsides, and the inspection result is determined to be unacceptable if adefect is detected for the image on either side.

Next, in step S0405, the CPU 0226 determines whether the inspectionresult is acceptable. If the inspection result is acceptable (YES instep S0405), the processing proceeds to step S0406. In step S0406, theacceptable inspection result is notified from the inspection unit I/F0231 to the inspection apparatus I/F 0215, i.e., the inspection unit I/F0231 instructs the inspection apparatus I/F 0215 to discharge the sheetto the main tray 0324 of the large capacity stacker 0107. The processingthen proceeds to step S0407, and the operations in step S0402 to stepS0407 are repeated until the inspection is completed for all the sheets.When the inspection is completed for all the sheets, the processingproceeds to step S0408. In step S0408, the CPU 0226 then receives aninstruction to end image reading at the display unit 0245 from the user.

If the inspection result is unacceptable (NO in step S0405), theprocessing proceeds to step S0409. In step S0409, the unacceptableinspection result is notified from the inspection unit I/F 0231 to theinspection apparatus I/F 0215, i.e., the inspection unit I/F 0231instructs the inspection apparatus I/F 0215 to discharge the sheet tothe top tray 0320 of the large capacity stacker 0107. The processingthen proceeds to step S0407 and the processing ends in a manner similarto the above-described case where the inspection result is acceptable.

The above-described processing is merely an example, and, for example,the image reading start instruction received from the user via thedisplay unit 0245 may be an automatic instruction to be providedsimultaneously with a print start instruction in the printing apparatus0101, the information processing apparatus 0109, or the client computer0110. The image reading end instruction received from the user via thedisplay unit 0245 may be an automatic instruction to be providedsimultaneously with the completion of printing in the printing apparatus0101, and the mode thereof is not limited.

FIG. 5 is an operation flowchart illustrating a basic operation of theinspection unit 0106 in performing inspection.

In step S0501, the CPU 0201 starts printing. Next, the processingproceeds to step S0502, and further to step S0503 in a case where thereis a sheet to be an inspection target. In step 0502, the process isrepeated until all sheets are processed.

In step S0503, the CIS 0315 and the CIS 0316 each scan an image printedon the conveyed sheet. Next, in step S0504, the inspection apparatus I/F0215 transmits the image scanned in step S0503 to the inspection unitI/F 0231.

Next, in step S0505, the CPU 0216 determines whether an inspectionresult from the inspection unit I/F 0231 is received by the inspectionapparatus I/F 0215. If the inspection result is received (YES in stepS0505), the processing proceeds to step S0506. In step S0506, the CPU0216 determines whether the inspection result is acceptable. If theinspection result is acceptable (YES in step S0506), the processingproceeds to step S0507. In step S0507, the accessory I/F 0214 instructsthe accessory I/F 0220 to discharge the sheet on which the image scannedin step S0503 is printed to the main tray 0324 of the large capacitystacker 0107. The processing proceeds to step S0508, and the operationsin step S0502 to step S0508 are repeated until the inspection iscompleted for all the sheets. When the inspection is completed for allthe sheets, printing is completed, and thus the processing ends.

If the inspection result is unacceptable (NO in step S0506), theprocessing proceeds to step S0509. In step S0509, the accessory I/F 0214instructs the accessory I/F 0220 to discharge the sheet on which theimage scanned in step S0503 is printed to the top tray 0320 of the largecapacity stacker 0107. The processing then proceeds to step S0508, andthe processing ends in a manner similar to the above-described casewhere the inspection result is acceptable.

If the inspection result is not received (NO in step S0505) due to somecauses, such as a situation where the inspection apparatus 0108 is notready for inspection and a situation where a computation in theinspection apparatus 0108 is late, the processing proceeds to stepS0509. In this process, the CPU 0216 notifies the accessory I/F 0214 ofthe discharge of the sheet to the top tray 0320 so that a product withthe acceptable inspection result and a product with the unacceptableinspection are not mixed. The accessory I/F 0214 instructs the accessoryI/F 0220 to discharge the sheet directly to a discharge destinationdesignated in a print job, and the processing proceeds to step S0508.Afterward, the processing ends in a manner similar to theabove-described case where the inspection result is received.

FIGS. 6A, 6B, and 6C each illustrate an inspection setting screendisplayed on the display unit 0245 of the inspection apparatus 0108. Aninspection setting screen 0601 includes a menu bar 0602 and aninspection parameter setting portion 0604. Displayed in the inspectionsetting screen 0601 is a reference image having been registered in aninspection job to which inspection settings are to be applied.

The menu bar 0602 includes an inspection criterion confirmation button0603. The menu bar 0602 further includes a reference image replacementbutton 0608 for replacing a reference image having been registered. Theinspection criterion confirmation button 0603 also serves as a displayscreen switching button for switching between two display screens to bedescribed below. The menu bar 0602 further includes a button 0609 forswitching a mouse pointer (not illustrated) for the display unit 0245 toreceive an instruction from the user at the coordinates thereof, between“grab” and “pointer”. The menu bar 0602 yet further includes a button0610 for designating an inspection region (described below) with arectangle, and a button 0611 for designating the inspection region withan oval. The menu bar 0602 yet further includes a button 0612 forundoing an executed process, a button 0613 for redoing a process, abutton 0614 for copying the inspection region, a button 0615 forclipping, a button 0616 for pasting, and a button 0617 for deletion. Themenu bar 0602 yet further includes a button 0618 for changing the zoommagnification and a button 0619 for fitting a displayed image to thescreen. The user sets the inspection region for each inspectioncriterion on the screen, by designating a button included in the menubar 0602. For example, the user can designate an inspection criterion“important” by selecting an item 0605 with the mouse, and can furtherdesignate a rectangular inspection region by selecting the button 0610with the mouse. Afterward, the user designates, for example, a region0622 illustrated in FIG. 6B on the image.

The inspection parameter setting portion 0604 receives a misalignmentsetting and an inspection parameter setting from the user. Themisalignment in the misalignment setting includes a permissible valuefor a misalignment, and the permissible value can be set by the user.FIG. 6A illustrates a setting for permitting a misalignment up to 1 mmin a sheet conveyance direction as “misalignment (vertical)”, and amisalignment up to 2 mm in a main scanning direction as “misalignment(lateral)”. In the printing apparatus 0101, a conveyance misalignmentcan occur during sheet conveyance, or a minute misalignment of theprinting position of an image with each sheet can occur. To avoid adecrease in inspection accuracy due to the occurrence of such amisalignment, the permissible value for the misalignment is defined.

Further, in the inspection parameter setting, the user can view aninspection level for each of a circular defect and a linear defect withrespect to each inspection criterion (“important” and “standard”), andchange an inspection level in a combo box. In the present exemplaryembodiment, inspection levels are defined as 7, 6, 5, 4, 3, 2, and 1 indescending order of strictness, and thus “important” and “standard” areset not to be reversed in terms of inspection level. This can beimplemented by, for example, changing the display such that only theinspection level 6 or 7 is enabled to be selected in “important” in acase where the inspection level 5 is selected in “standard”. In thepresent exemplary embodiment, a region (an inspection exclusion region)for which an inspection criterion “exclusion” is designated is not to beinspected, and thus there is no combo box for selecting an inspectionlevel.

The user can change the color of the frame of the inspection region towhich the corresponding inspection criterion is to be applied, bydesignating the item 0605. When the item 0605 is clicked, for example, acolor selection menu (not illustrated) opens and presents options, andthe display unit 0245 receives the change of the color based on oneselected from among the options by the user.

FIG. 6B illustrates a state where the inspection region is rendered bythe user, and the display unit 0245 receives selection and varioussettings made by the user. FIG. 6B indicates that the inspectioncriterion “important” is currently selected by displaying the option“important” in reverse video. In FIG. 6B, the inspection criterion“important” is designated for inspection regions 0622, 0623, and 0625.The inspection criterion “standard” is designated for an inspectionregion 0624. The inspection criterion “exclusion” is designated for aninspection region 0626.

In the present exemplary embodiment, in a case where the inspectionregions overlap (e.g., regions 0623 and 0622) as illustrated in FIG. 6B,the inspection criterion is applied in order of priority, i.e., in theorder of the inspection exclusion, the inspection levels 7, 6, 5, 4, 3,2, and 1. This can be implemented by, for example, performing theinspection after determining with which inspection criterion each pixelis to be inspected, based on coordinates in the image in the inspection.Alternatively, all the pixels may be inspected at each inspection levelonce, and if the same pixels are redundantly inspected at differentinspection levels, the inspection result may be determined based on theabove-described order of priority. As the inspection level becomeshigher, the determination criterion for the inspection is set to astricter level. In the present exemplary embodiment, the region forwhich the inspection exclusion is designated is assumed to be such aregion where a number different for each sheet is printed. Thus, theinspection exclusion is assigned the highest priority so that thisregion is not always inspected. However, for example, in a case where itis desirable to always inspect every designated region, the inspectionexclusion may be assigned the lowest priority. In either case,information indicating the priority is retained and the inspectioncriterion is applied based on the priority. For the inspection levels,the order of priority is set so that a higher priority is assigned to ahigher inspection level.

When the inspection criterion confirmation button 0603 is pressed, astate illustrated in FIG. 6C appears. This state expresses with whichinspection criterion the pixel is to be inspected through area filling,based on the above-described order of priority. Regions 0627 and 0628are each indicated as a region corresponding to the inspection criterion“important”. A region 0629 is indicated as a region corresponding to theinspection criterion “standard”. A region 0630 is indicated as a regioncorresponding to the inspection “exclusion”. In the present exemplaryembodiment, the color of each of the regions 0627 and 0628 and the colorof the item 0605 are set to the same, the color of the region 0629 andthe color of an item 0620 are set to the same, and the color of theregion 0630 and the color of an item 0621 are set to the same. Thismakes it easy for the user to check which inspection criterioncorresponds to which region. The example in which the colors are madethe same is described, but instead of the color, a pattern may be usedif a plurality of criteria and regions corresponding thereto can beidentified. Further, in FIG. 6B as well, the color of the frame line ofeach of the regions 0622, 0623, and 0625 may be the same as the color ofeach of the region 0627, the region 0628, and the item 0605. The colorof the frame line of the region 0624 may be the same as the color ofeach of the region 0629 and the item 0620, and the color of the frameline of the region 0626 may be the same as the color of each of theregion 0630 and the item 0621.

When the inspection criterion confirmation button 0603 is pressed again,the state illustrated in FIG. 6B appears. In FIG. 6B, the user can checkthat the region 0624 and the region 0625 overlap each other, and theregion 0625 and the region 0626 overlap each other. In FIG. 6C, anoverlapping region between the region 0624 and the region 0625 in FIG.6B is the region 0628 and thus the user can check that this overlappingregion corresponds to the inspection criterion “important”. Further, anoverlapping region between the region 0625 and the region 0626 in FIG.6B is the region 0630 and thus the user can confirm that thisoverlapping region corresponds to the inspection criterion “exclusion”.

The operation performed in each of FIG. 6B and FIG. 6C may be, insteadof being the press of the inspection criterion confirmation button 0603,for example, a mode in which the state illustrated in FIG. 6C appearswhen the mouse pointer is placed at the inspection criterionconfirmation button 0603 may be employed. In such a case, the stateillustrated in FIG. 6B appears when the mouse pointer leaves theinspection criterion confirmation button 0603.

The inspection setting screen 0601 further includes a “cancel” button0607 for cancelling the setting and a “complete” button 0606 for endingthe setting.

Processing corresponding to a characteristic of the present exemplaryembodiment will be described below with reference to a flowchart inFIGS. 7A and 7B.

A program for the printing apparatus 0101 according to the processing ofthis flowchart is stored in the storage unit 0205 of the printingapparatus 0101, read out into the RAM 0202, and executed by the CPU0201. A program for the inspection apparatus 0108 according to theprocessing of the flowchart is stored in the storage unit 0228 of theinspection apparatus 0108, read out into the program into the RAM 0227,and executed by the CPU 0226. A program for the information processingapparatus 0109 according to the processing of the flowchart is stored inthe storage unit 0236 of the information processing apparatus 0109, readout into the RAM 0235, and is executed by the CPU 0234. A program forthe client computer 0110 according to the processing of the flowchart isstored in the storage unit 0244 of the client computer 0110, and readout into the RAM 0242, so that the CPU 0243 executes the program.

First, in step S0701, the CPU 0226 creates an inspection job. Theinspection job is the unit of a record that holds information about theinspection, such as the reference image, the number of inspectionsheets, and the inspection settings. The inspection job also includesinformation indicating whether the inspection target is two-sided orone-sided. In a case where the information indicates the two-sidedinspection target, the following processing is performed on an image oneach of both sides. In a case where the information indicates theone-sided inspection target, the following processing is performed on animage on one side. Next, in step S0702, the CPU 0226 starts reading thereference image. At this time, the inspection unit I/F 0231 notifies theinspection apparatus I/F 0215 of the start of the reading of thereference image. The CPU 0216 then instructs the imaging unit 0218 toprepare for the reading of the reference image, and when the preparationis completed, the CPU 0216 notifies the CPU 0226 of the completion ofthe preparation via the inspection apparatus I/F 0215 and the inspectionunit I/F 0231. The inspection unit I/F 0231 receives the image printedby the printing apparatus 0101 and scanned by each of the CIS 0315 andthe CIS 0316 from the inspection apparatus I/F 0215. In the case wherethe inspection target is one-sided, the inspection unit I/F 0231receives (acquires) the image scanned by each of the CIS 0315 and theCIS 0316, and in and after step S703, only the image obtained byscanning the printed surface is used.

Next, in step S0703, the CPU 0226 creates the reference image. In a casewhere the reference image is to be created based only on an imageobtained by scanning one printed sheet, the reference image is thescanned image received in step S702. In a case where the reference imageis to be created by combining a plurality of images, a plurality ofscanned images is received in step S702, and the reference image iscreated by combining the received images. Examples of combining imagesto provide the reference image include: (1) taking the average of allthe images; (2) perform a filtering operation on the images, etc. Next,in step S0704, the CPU 0226 displays the reference image created in stepS0703 on the display unit 0245.

Next, the processing proceeds to step S0705, and in step S0706 to stepS0708, the display unit 0245 receives setting of the inspection regiondesired by the user via the buttons and the inspection parameter settingportion 0604 included in the menu bar 0602. In step S0706, the displayunit 0245 receives selection of the inspection criterion by the user viathe inspection parameter setting portion 0604. Next, in step S0707, thedisplay unit 0245 selects the inspection level to be applied to theinspection criterion selected in step S0706 via the inspection parametersetting portion 0604. The processing may proceed in the order in whichthe user selects the inspection criterion after setting the inspectionlevel for the inspection criterion, i.e., the order is not limited.

Next, in step S0708, the display unit 0245 receives rendering of theinspection region by the user after receiving selection of the rectangleor oval in the menu bar 0602. Next, in step S0709, the display unit 0245displays the reference image including the rendered inspection region inthe inspection setting screen 0601.

Next, in step S0710, the CPU 0226 determines whether the color of theinspection parameter is to be changed. If the color of the inspectionparameter is to be changed (YES in step S0710), the processing proceedsto step S0711. In step S0711, the display unit 0245 changes the color ofthe frame of the inspection region to which the corresponding inspectioncriterion is to be applied. Subsequently, the processing proceeds tostep S0712, and the operations in step S0705 to step S0712 are repeateduntil all the inspection regions are rendered and the colors aredetermined for the inspection regions. Even if the color of theinspection parameter is not to be changed (NO step S0710), theprocessing proceeds to step S0712, and the processing can proceed in amanner similar to the above-described case.

In the present exemplary embodiment, the processing has been describedin which the color of the frame of the inspection region is changedafter the region is rendered, but the processing may proceed in theorder in which the frame of the inspection region to which theinspection criterion is to be applied is rendered after the colorcorresponding to the inspection criterion is changed. In other words,the rendering of the inspection region and the changing of the color ofthe frame of the inspection region are not limited in terms of timingand order.

Next, in step S0713, the CPU 0226 determines whether an instruction tocheck the overlap between the inspection regions from the user isreceived by the display unit 0245 via the inspection criterionconfirmation button 0603. If the instruction is received (YES in stepS0713), the processing proceeds to step S0714. In step S0714, the CPU0226 checks the inspection level applied to a target pixel. In stepS0715, the CPU 0226 determines whether the inspection level is“exclusion”. If the inspection level is determined to be “exclusion”(YES in step S0715), the processing proceeds to step S0716. In stepS0716, the inspection level “exclusion” is set for the pixel and theprocessing proceeds to step S0722. If the inspection level is notdetermined to be “exclusion” (NO in step S0715), the processing proceedsto step S0719. In step S0719, the CPU 0226 determines whether theinspection level is “important”. If the inspection level is determinedto be “important” (YES in step S0719), the processing proceeds to stepS0720. In step S0720, the inspection level “important” is set for thepixel and the processing proceeds to step S0722. If the inspection levelis not determined to be “important” (NO in step S0719), the processingproceeds to step S0721. In step S0721, the inspection level “standard”is applied to the pixel, and the processing proceeds to step S0722.

Afterward, the operations in step S0714 to step S0722 are repeated untilthe inspection levels are applied to all the pixels. In step S0723, thedisplay unit 0245 displays an image (corresponding to the image in FIG.6C) in which the overlap between the inspection regions is filled, basedon the inspection level of each of the pixels applied up to step S0722.FIG. 6C illustrates the screen in which the inspection level identifiedbased on the priority is displayed for the overlap region. In stepS0724, the CPU 0226 determines whether an instruction to stop thechecking of the overlap between the inspection regions from the user isreceived by the display unit 0245 via the inspection criterionconfirmation button 0603. If the instruction is received (YES in stepS0724), the processing proceeds to step S0725. In step S0725, thedisplay unit 0245 displays the reference image (corresponding to theimage in FIG. 6B) in which the frame of the inspection region isrendered, and the processing proceeds to step S0726. FIG. 6B illustratesthe screen in which the frames of the plurality of inspection regionsare displayed. If the instruction to stop the checking of the overlapbetween the inspection regions from the user is not received (NO in stepS0724), the processing directly proceeds to step S0726.

In step S0726, the CPU 0226 determines whether the setting is completedfor all the inspection parameters. The CPU 226 determines that thesetting is completed for all the inspection parameters in a case wherethe display unit 0245 receives a notification of the completion of theinspection parameter setting from the user via the complete button 0606.If the setting is completed (YES in step S0726), the processing proceedsto step S0727. In step S0727, the inspection parameters are set for thereference images and saved into the RAM 0227 so that the inspectionparameters can be used for the inspection. If the setting is notcompleted, i.e., if the notification of the completion of the inspectionparameter setting from the user is not received by the display unit 0245via the complete button 0606 (NO in step S0726), the processing returnsto step S0705 and is repeated until the setting of the inspectionparameters is completed.

If the instruction to check the overlap between the inspection regionsfrom the user is not received by the display unit 0245 via theinspection criterion confirmation button 0603 (NO in step S0713), theprocessing proceeds to step S0726. In step S0726, the processing can endin a manner similar to the above-described case.

Next, operation of the inspection apparatus 0108 when the inspection isperformed using the inspection settings set in the above-describedprocedure will be described with reference to a flowchart in FIG. 8.

First, in step S0801, the CPU 0226 starts reading the inspection targetimage. At this moment, the inspection unit I/F 0231 notifies theinspection apparatus I/F 0215 of the start of the reading of theinspection target image. The CPU 0216 then instructs the imaging unit0218 to prepare for the reading of the inspection target image, and whenthe preparation is completed, the CPU 0216 notifies the CPU 0226 of thecompletion of the preparation via the inspection apparatus I/F 0215 andthe inspection unit I/F 0231. In step S0802, the client computer 0110transmits PDF data to the information processing apparatus 0109 via theNW I/F 0240 and the NW I/F 0237. Further, the CPU 0234 transmits the PDFdata to the printing apparatus 0101 via the NW I/F 0238, the NW I/F0207, the video I/F 0233, and the video I/F 0206. The CPU 0201 printsthis PDF data. The CIS 0315 and the CIS 0316 then each scan the printedimage when the image passes through the sheet conveyance path 0317. TheCPU 0226 receives the scanned image from the inspection unit 0106 viathe inspection apparatus I/F 0215 and the inspection unit I/F 0231. ThePDF data may be imported to the information processing apparatus 0109beforehand, and the CPU 0234 may read out the PDF data from the storageunit 0236 in step S0702. The PDF data may be stored in the storage unit0205 of the printing apparatus 0101 and the CPU 0201 may read out thePDF data from the storage unit 0205. In other words, the PDF data is notlimited in terms of mode if the PDF data is printed by the printingapparatus 0101.

Next, in step S0803, the CPU 0226 reads out the reference image createdin step S0703 from the storage unit 0228, and compares the referenceimage with the inspection target image received in step S0802, thusdetermining whether a misalignment is unacceptable. The CPU 0226compares the positional relationship between the sheet and the printedimage in the reference image and the positional relationship between thesheet and the printed image in the inspection target image received instep S0802. The comparison between the positional relationships iscalculated using, for example, the four corners of the sheet, and anaffine transformation value of an image feature point extracted throughedge detection of the printed image. If the position of the printedimage relative to the sheet deviates by the permissible value formisalignment set beforehand, i.e., the misalignment is unacceptable (YESin step S0803), the processing proceeds to step S0814. In step S0814,the CPU 0226 notifies the CPU 0216 of the unacceptable inspectionresult, via the inspection unit I/F 0231 and the inspection apparatusI/F 0215. The CPU 0216 then notifies the CPU 0221 of the unacceptableinspection result, via the accessory I/Fs 0214 and 0220. The CPU 0221instructs the sheet discharge unit 0223 to discharge the sheet to thetop tray 0320 and the processing ends.

If a misalignment of the position of the printed image relative to thesheet falls within the range of the permissible values for misalignmentsin the inspection target image, i.e., the misalignment is notunacceptable (NO in step S0803), the processing proceeds to step S0804.In step S0804, the CPU 0226 starts inspecting the pixels of theinspection target image one by one. In step S0805, the CPU 0226 refersto the inspection settings made in step S0727, and checks whether theinspection criterion “exclusion” is set for the pixel. If the inspectioncriterion “exclusion” is set (YES in step S0805), the processingproceeds to step S0811, without inspecting the pixel.

If the inspection criterion “exclusion” is not set for the pixel (NO instep S0805), the processing proceeds to step S0808. In step S0808, theCPU 0226 confirms whether the inspection criterion “important” is set.If the inspection criterion “important” is set (YES in step S0808), theprocessing proceeds to step S0809. In step S0809, the CPU 0226 inspectsthe pixel using the inspection criterion “important”, and the processingproceeds to step S0811. If the inspection criterion “important” is notset (NO in step S0808), the processing proceeds to step S0810. In stepS0810, the CPU 0226 inspects the pixel using the inspection criterion“standard”, and the processing proceeds to step S0811.

If the inspection is not completed for all the pixels in step S0811, theoperation returns to step S0804, and the inspection is performed untilthe inspection is completed for all the pixels. When the inspection iscompleted for all the pixels, the processing proceeds to step S0816. Instep S0816, the CPU 0226 checks whether the time for notifying theinspection result from the inspection unit I/F 0231 to the inspectionapparatus I/F 0215 has run out. This step is provided because if aninstruction to switch the discharge destination between the main tray0324 and the top tray 0320 is not issued within a certain period oftime, the sheet is conveyed and the time for switching runs out. If theinspection apparatus I/F 0215 cannot notify the inspection result (YESin step S0816), the processing proceeds to step S0814. In step S0814,the inspection unit I/F 0231 instructs the inspection apparatus I/F 0215to discharge the sheet to the top tray 0320. If the inspection apparatusI/F 0215 can notify the inspection result (NO in step S0816), theprocessing proceeds to step S0812. In step S0812, the CPU 0226 checkswhether a pixel corresponding to the unacceptable inspection result ispresent in either step 0809 or step 0810. If a pixel corresponding tothe unacceptable inspection result is present (YES in step S0812), theprocessing proceeds to step S0814, and afterward, the processing ends ina manner similar to the above-described case where the misalignment isunacceptable. If a pixel corresponding to the unacceptable inspectionresult is not present (NO in step S0812), the processing proceeds tostep S0813. In step S0813, the inspection unit OF 0231 instructs theinspection apparatus I/F 0215 to discharge the sheet to the main tray0324, and the processing proceeds to step S0815. Afterward, theoperations in step S0801 to step S0815 are repeated until the inspectionis completed for all the inspection target images, and the processingends.

In the present exemplary embodiment, the configuration has beendescribed in which a misalignment is first detected before theinspection for the circular defect and the linear defect, but these maybe performed in parallel, or the circular defect and the linear defectmay be inspected first, i.e., the mode thereof is not limited.

In the present exemplary embodiment, the example has been described inwhich the printing apparatus 0101 and the inspection apparatus 0108 areseparate apparatuses, but a means corresponding to the inspectionapparatus may be included in the printing apparatus.

According to the present exemplary embodiment, the above-describedprocedure enables the user to easily recognize the inspection criterionapplied to each pixel even in a case where the inspection regionsoverlap in the inspection apparatus. This makes it easy for the user toapply a desired inspection criterion to a desired inspection target, sothat an inspection desired by the user can be implemented withoutoperation mistakes.

According to the above-described exemplary embodiment, the user caneasily recognize which inspection criterion is to be applied to a pixelin a case where there is an overlap between inspection regions to whichdifferent inspection criteria are applied.

Other Embodiments

Embodiment(s) of the disclosure can also be realized by a computer of asystem or apparatus that reads out and executes computer executableinstructions (e.g., one or more programs) recorded on a storage medium(which may also be referred to more fully as a ‘non-transitorycomputer-readable storage medium’) to perform the functions of one ormore of the above-described embodiment(s) and/or that includes one ormore circuits (e.g., application specific integrated circuit (ASIC)) forperforming the functions of one or more of the above-describedembodiment(s), and by a method performed by the computer of the systemor apparatus by, for example, reading out and executing the computerexecutable instructions from the storage medium to perform the functionsof one or more of the above-described embodiment(s) and/or controllingthe one or more circuits to perform the functions of one or more of theabove-described embodiment(s). The computer may comprise one or moreprocessors (e.g., central processing unit (CPU), micro processing unit(MPU)) and may include a network of separate computers or separateprocessors to read out and execute the computer executable instructions.The computer executable instructions may be provided to the computer,for example, from a network or the storage medium. The storage mediummay include, for example, one or more of a hard disk, a random-accessmemory (RAM), a read only memory (ROM), a storage of distributedcomputing systems, an optical disk (such as a compact disc (CD), digitalversatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, amemory card, and the like.

While the disclosure has been described with reference to exemplaryembodiments, it is to be understood that the disclosure is not limitedto the disclosed exemplary embodiments. The scope of the followingclaims is to be accorded the broadest interpretation so as to encompassall such modifications and equivalent structures and functions.

This application claims the benefit of Japanese Patent Application No.2019-205589, filed Nov. 13, 2019, which is hereby incorporated byreference herein in its entirety.

What is claimed is:
 1. An information processing apparatus that sets aninspection level to be used in determining quality of an image of aninspected surface of a printed sheet, based on a comparison between acaptured image resulting from imaging the inspected surface and areference image, the information processing apparatus comprising: amemory containing instructions; and a processor configured to executethe instructions to perform operations comprising: setting a pluralityof inspection regions varying in inspection level, for the referenceimage, identifying, in a case where an overlap region is present in theplurality of inspection regions, the inspection level of the overlapregion based on a predetermined priority, and displaying the identifiedinspection level of the overlap region.
 2. The information processingapparatus according to claim 1, wherein the operations furthercomprises: acquiring a captured image resulting from imaging aninspected surface of a printed sheet; and determining quality of theinspected surface of the printed sheet, based on the acquired capturedimage, the reference image, and the set inspection level, whereindetermining the quality comprises determining the quality using theidentified inspection level of the overlap region in a case where theoverlap region is present in the plurality of inspection regions.
 3. Theinformation processing apparatus according to claim 1, wherein theoperations further comprises receiving a display switching instruction,wherein displaying comprises switching display from a screen displayingthe identified inspection level of the overlap region to a screendisplaying a frame of each of the plurality of inspection regions, in acase where receiving receives the display switching instruction.
 4. Theinformation processing apparatus according to claim 1, wherein thepriority becomes higher as an inspection level becomes higher.
 5. Theinformation processing apparatus according to claim 1, wherein settingcomprises setting an inspection exclusion region, and wherein theinspection exclusion region is assigned highest priority.
 6. A methodfor controlling an information processing apparatus that sets aninspection level to be used in determining quality of an image of aninspected surface of a printed sheet, based on a comparison between acaptured image resulting from imaging the inspected surface and areference image, the control method comprising: setting a plurality ofinspection regions varying in inspection level, for the reference image;identifying, in a case where an overlap region is present in theplurality of inspection regions, the inspection level of the overlapregion based on a predetermined priority; and controlling display todisplay the identified inspection level of the overlap region.
 7. Themethod according to claim 6, further comprising: acquiring a capturedimage resulting from imaging an inspected surface of a printed sheet;and determining quality of the inspected surface of the printed sheet,based on the acquired captured image, the reference image, and the setinspection level, wherein the quality is determined using the identifiedinspection level of the overlap region in a case where the overlapregion is present in the plurality of inspection regions.
 8. The methodaccording to claim 6, further comprising receiving a display switchinginstruction, wherein the display is switched from a screen displayingthe identified inspection level of the overlap region to a screendisplaying a frame of each of the plurality of inspection regions, in acase where the display switching instruction is received.
 9. The methodaccording to claim 6, wherein the priority becomes higher as aninspection level becomes higher.
 10. The method according to claim 6,wherein in a case where an inspection exclusion region is set, theinspection exclusion region is assigned highest priority.